Topological phase transitions of random networks 
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To provide a phenomenological theory for the various interesting transitions in restructuring networks we 
employ a statistical mechanical approach with detailed balance satisfied for the transitions between topological 
states. This enables us to establish an equivalence between the equilibrium rewiring problem we consider and 
the dynamics of a lattice gas on the edge-dual graph of a fully connected network. By assigning energies to the 
different network topologies and defining the appropriate order parameters, we find a rich variety of topological 
phase transitions, defined as singular changes in the essential feature(s) of the global connectivity as a function 
of a parameter playing the role of the temperature. In the "critical point" scale-free networks can be recovered. 
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One of the most fruitful recent approaches to the descrip- 
tion of complex systems consisting of many similar units has 
been the analysis of the underlying network of interactions. 
It has turned out that seemingly very different systems can 
be characterized by a few major classes of stochastic graphs 
representing the overall features of the structure of connec- 
tions among the units dOl- These developments have greatly 
advanced our potential to interpret the fundamental common 
features of diverse systems including social groups, techno- 
logical, biological and other networks. The effects of both the 
restructuring |3] and the growth |4] of the associated graphs 
have been considered leading to a number of exciting discov- 
eries about the laws concerning their diameter, clustering and 
degree distribution. 

Although the conceptual basis of most of the related works 
has largely relied on analogies (scaling, percolation, etcj with 
statistical mechanics, only very few recent works | fjIsLZI] have 
been devoted to the problem of directly connecting the graph 
theoretical aspects of networks to statistical mechanics or ther- 
modynamics. On the other hand, using a thermodynamic for- 
malism for the changes in graphs being in an equilibrium-like 
state is expected to provide a significantly deeper insight into 
the processes taking place in systems being in a saturated state 
and, as such, dominated by the fluctuating rearrangements of 
links between their units. 

As an example, let us take a given number of units inter- 
acting in a "noisy" environment. These units can be people, 
firms, genes, etc. The probability for establishing a new or 
ceasing an existing interaction/connection between two units 
depends on both the noise and the advantage/disadvantage 
gained/lost when adopting the new configuration. In this pic- 
ture, a global transition in the connectivity properties can oc- 
cur as a function of the level of perturbations. For instance, if 
the conditions are such that the interactions between the part- 
ners become more "conservative" (a relative, short term gain 
is more highly valued), as we show later, a transition from 
a less ordered to a more ordered network configuration can 
take place. In particular, it has been argued 1 8] that depending 
on the level of given types of uncertainties (expected fluctua- 
tions) business networks reorganize from a star-like topology 



to a system of more cohesive, highly clustered ties. 

In this paper we use temperature to represent noise and dif- 
ferences in an energy (potential) type quantity to account for 
advantage or loss during the rearrangement of a network. This 
enables us to treat the associated microscopic dynamics within 
the framework of canonical ensembles and map the problem 
onto a lattice gas model. After defining an order parameter 
and a variety of possible potentials, interesting topological 
phase transitions (first and second order) are found both an- 
alytically and by numerical simulations. Scale-free networks 
are recovered at the transition point between a system consist- 
ing of many nodes with few links to a system dominated by a 
single large hub. 

We define the partition function 

Z{T) = ]T e' E ^ T (1) 

for an ensemble {g a } of undirected graphs containing N 
nodes and M links, where E a denotes the energy of the graph 
g a - Our choice for Z is in analogy with that proposed by Berg 
and Lassig |6] and is motivated by the following physical pic- 
ture behind the graph restructuring process: The basic event 
of the rearrangement is the relocation of a randomly selected 
edge (link) to a new position either by "diffusion" (keeping 
one end of the edge fixed and connecting the other one with 
a new node) or by removing the given edge and connecting 
two randomly selected nodes. Then, the energy difference 
AE a b = Eb — E a between the original g a and the new gb 
configurations is calculated and the relocation is carried out 
following the Metropolis algorithm. The resulting dynamics, 
by construction, satisfies the detailed balance condition. 

This network rearrangement is formally equivalent to a 
Kawasaki type lattice gas dynamics with conserved number 
of particles moving on a special lattice^which is the edge-dual 
graph of the fully connected network |9, 10]. The sites of this 
lattice are the possible N(N — l)/2 connections between the 
vertices, and the particles wandering on the sites are the M 
edges. 

To be able to monitor topological phase transitions a suit- 
able order parameter <£> has to be introduced. As we are 
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primarily interested in the transitions between dispersed and 
compact states, a natural choice can be either $ = $ s = 
s max /M, the number of edges of the largest connected com- 
ponent of the graph s max normalized by the total number of 
edges M, or $ = $fe = k max /M, the highest degree in the 
graph fc max divided by M. We also introduce the correspond- 
ing conditional free energy F(<£>, T) via 
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where {g a }$ is a subset of {g a } and contains the graphs with 
the same order parameter <£>. 

In the T — > oo limit the dynamics converges to a totally 
random rewiring process, and thus, the classical Erdos-Renyi 
(ER) |11] random graphs are recovered. On the other hand, 
at low temperatures the topologies with lowest energy occur 
with enhanced probability. If the energy function is chosen 
such that compact configurations (which occur exceptionally 
rarely in the ER graphs) have low energies, then in an inter- 
mediate temperature range we expect to see a competition be- 
tween the entropically favorable dispersed configurations and 
the energetically favorable compact ones. This is manifested 
in the shift of the minimum of the conditional free energy 
F($, T) from $ = towards higher values of $ as the tem- 
perature T is decreased from infinity to zero. A sudden change 
in the position of the global minimum signals a discontinuous 
(first order) phase transition, whereas a gradual shift indicates 
either a cross-over or a continuous (second order) phase tran- 
sition. 

In the classical random graph model |9] (corresponding to 
T — > oo) by varying the average degree of the vertices (k) = 
2M/N, a percolation phase transition occurs at (k) = 1. For 
(k) < 1 the graphs falls apart into small pieces, while for 
(k) > 1 a giant connected component emerges. Near the criti- 
cal point the size of this giant component scales as ((k) — l)M. 

Based on the lattice gas analogy we expect that if (k) < 1, 
then for a suitable choice of the energy (one that rewards clus- 
tering) a similar dispersed-compact phase transition occurs at 
a finite temperature T((k)). Such a transition can be best 
monitored by the order parameter $ s = s max /M la lllll . 

The most obvious energy satisfying the above requirement 
is a monotonically decreasing function E — f(s max ). It can 
be shown (by counting the number of configurations) that the 
conditional free energy up to second order in $ s (and after 
omitting the $ s independent terms) can be approximated by 
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in the N, M -> oo limit for fixed (fc) = 2M /N. 

The simplest choice for the energy function is /(s max ) = 
—Smax- In this case it can be clearly seen from Eq. that 
as long as 1/T < 1/T c ((fc» = (k) - 1 - ln((fc», the free 
energy has a minimum at $ s = <&*(T) = 0, i.e., the con- 
figuration is dispersed (see main panel of Fig. [Q. When the 
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FIG. 1: The phase diagram and the order parameter for the E — 
— Smax energy. Main panel: The white and shaded areas correspond 
to the ordered phase (containing a giant component) and the disor- 
dered phase, respectively. Inset: The order parameter $ = $ s = 
Smax/M obtained from Monte-Carlo simulations as a function of 
the inverse temperature for (k) =0.1 (triangles) and (k) — 0.5 
(circles). Each data point is an ensemble average of 10 runs, time 
averaged between t = WON and 5007V Monte-Carlo steps. The 
open and closed symbols represent TV = 500 and 1,000 vertices, 
respectively. The critical exponent, in agreement with the analytical 
approximations (solid lines), was found to be 1. 

temperature drops below T c ((fc)), the minimum moves away 
from $3 = and a giant component appears. Near the 
critical temperature T c ((fc)) the order parameter at the min- 
imum of the free energy can be estimated from Eq. (|3} as 
$*(T) = 2[1/T - l/T c ((fc))]/[(fc) 2 - 3(fc) + 2], indicat- 
ing that we are dealing with a second order topological phase 
transition (see inset of Fig. [Q. 

For other forms of /(s max ), such as — s max or 
— Smax ln(s max ), first order topological phase transitions are 
also expected to occur. We have found such transitions numer- 
ically (not shown). In addition, similar results are expected for 
any (non-global) energy E = J2j /( s i)> where the summa- 
tion goes over each connected component and Sj denotes the 
number of edges in the jth one. However, because the total 
number of edges, M = J^j s j< i s conserved by the dynamics, 
f(sj) must decrease faster than — Sj in this case. 

Next we turn to another important class of the energy 
functions, where the energies are assigned to the vertices 
rather than to the connected components of the graph: E = 
/(ki)> where fcj denotes the degree (number of neigh- 
bors) of vertex i. This energy is consistent with a dynam- 
ics, in which the change of the degree of a vertex depends 
only on the structure of the graph in its vicinity. The fit- 
ness of an individual vertex depends on its connectivity. The 
most suitable order parameter for this class of graph energy is 
$fc = k max /M. Again, due to the conservation of the number 
of edges, M — ^V ki, the single vertex energy f(ki) should 
decrease faster than — ki, if aggregation is to be favored. 

If we express the single vertex energy in the form /(fcj) = 
kig(ki), then the total energy of the graph can also be written 
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FIG. 2: The order parameter <3> = <l>fc = fc max /M as a function 
of the temperature and the system size for E = ^\ — kl/2 and 
(k) — 0.5. The simulations started either from a star (corresponding 
to T = 0, solid line) or a classical random graph (T = oo, dashed 
line). Each data point represents a single run, time averaged between 
t = 100iV and 200iV Monte-Carlo steps. The thick solid line shows 
the analytically calculated spinodal Xi = Mj ln(iV). 



all vertices that are neighbors of vertex i. Therefore, the graph 
energy can also be interpreted in such a way, that every vertex 
i collects an energy <?(fc;') from each of its neighbors. In this 
interpretation, the fitness of an individual vertex depends on 
the connectivities of its neighbors. 

A relevant case is when /(&•;) = — (J/2)fc|, or equiva- 
lently, g(ki) = — (J/2)fcj, corresponding to a linear prefer- 
ence of the number of pairs that can be chosen from the edges 
of a vertex, or the number of edges owned by the neighbors 
of a vertex. Furthermore, this form is in full analogy with the 
usual definition of the energy E = —Jj2<i j> n i n j of a lat- 
tice gas on the edge-dual graph of the fully connected network 
with nearest neighbor attraction. The summation here runs 
over all adjacent pairs of lattice sites, and rii = 1 if site i is 
occupied and otherwise. When this energy is applied to nor- 
mal cubic lattices, we recover the standard lattice gas model 
of nucleation of vapors. The negative energy unit — J associ- 
ated with a pair of edges sharing a vertex in the original graph 
is equivalent to the binding energy between the corresponding 
occupied nearest neighbor sites on the edge-dual graph. By 
measuring the energies (and temperature) in units of J we can 
set J = 1, without loosing generality. Thus, from now on J 
will be omitted. 

For f(ki) = —kf/2, the topology with the lowest overall 
energy is a "star", where all the M edges are connected to a 
single node. Both Monte-Carlo (MC) simulations (see Fig. [2} 
and a simple theoretical approximation indicate that a first or- 
der phase transition occurs between a dispersed configuration 
and a star as the temperature is varied. For large enough sys- 
tems, a sudden change of the order parameter between zero 
and one can be observed. The hysteresis appearing between 
cooling and heating is consistent with a first order transition. 

The numerical results are supported by a simple theoret- 



ical analysis of the free energy. The idea is to focus on 
the regime, where the most highly connected vertex has al- 
ready accumulated the majority of the edges (<!>£, > 1/2) and, 
thus, the energy of the entire graph can be approximated by 
/(^max) = — Then, in the thermodynamic limit, the 

free energy to leading order can be written as 
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where the $fe independent terms have been dropped. Note that 
this approximation would be valid even for &k < 1/2, if the 
energy of the graph was simply defined as E = /(fc max ). 

For/($ fc Af) = -($ fe M) 2 /2 the parabola given by Eq. 10 
has a maximum at $ fe = T/M ln(A). When T — > 0, this 
maximum also shifts towards zero and F($k, T) becomes a 
descending parabola on the [0, 1] interval. This means that 
the minimum of the free energy is at $^ = 1, the star con- 
figuration. In contrast, when the temperature goes above the 
T\ = M / In (AT) spinodal point (thick solid line in Fig. |2ji, 
the maximum leaves the [0, 1] interval and the free energy be- 
comes an ascending parabola, resulting in a minimum at a low 
value of $fc (corresponding to an ER random graph). How- 
ever, this value cannot be deduced from Eq. (0}, because it is 
a valid approximation only for $fc > 1/2. For intermediate 
temperatures the maximum of the parabola separates the two 
extreme topologies (the dispersed random graph and the star), 
among which one is a metastable configuration and the other 
one is absolutely stable. 

Another application-motivated choice for the single ver- 
tex energy is /(fcj) = — fcjln(fcj), or equivalently, g(ki) = 
— ln(fci), inspired, in part, by the logarithmic law of sensation. 
It is the logarithm of the degree of a vertex that its neighbors 
can sense and benefit from. For this energy the configuration 
of lowest energy is a fully connected subgraph [or almost fully 
connected if M cannot be expressed as n(n — l)/2]. How- 
ever, the star configuration is also quite favorable. The or- 
der parameter $fc = k max /M can easily distinguish between 
these two configurations, because fc max w y2M for a fully 
connected subgraph and fc max » M for a star. Our MC simu- 
lations demonstrate (Fig. [3 that as we cool down the system, 
the dispersed random graph first assembles to a configuration 
with a few large stars (sharing most of their neighbors), and 
then at lower temperatures it reorganizes into an almost fully 
connected subgraph. The hysteresis near this latter transition 
suggests that it is a first order phase transition. On the other 
hand, the former transition is accompanied by a singularity in 
the heat capacity and no hysteresis is observed, indicating that 
it is a second order phase transition. 

For $fc > 1/2 Eq. © can be used again as a good ap- 
proximation for the free energy of the graph. By plugging 
/($fcM) = — ($fcM) ln($fcM) into that expression, we get 
F(<f> k ,T)/(MT) » (1 - l/T)ln(A)$ fc to leading order, 
which is linear in In agreement with our observations 
above, this formula predicts that for T < 1 the star is a stable 
configuration ($^=1 is a minimum of the free energy), and 
for T > 1 it becomes unstable. The transition at T = T c = 1 
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FIG. 3: Phases of the graph when the energy is E = 
— ^2 fa ln(fe). (a) The largest degree femax for N = 10, 224 ver- 
tices and M = 2, 556 edges. Each data point represents a single run, 
time averaged between t = 5, OOOiV and 20, OOOiV MC steps. The 
data points are connected to guide the eye. There is a sharp, continu- 
ous transition near T — 0.85 and a first-order transition (with a hys- 
teresis) around T = 0.5 — 0.6. (b) The three different plateaus in (a) 
correspond to distinct topological phases: fc max = 0(1) to the clas- 
sical random graph, fc max = 0(M) to the star phase (a small number 
of stars sharing most of their neighbors) and fc max = Q(y~M) to the 
fully connected subgraph, (c) The (cumulative) degree distribution 
at T = 0.84 and t = 6007V follows a power law. 

is thus step-like with no hysteresis, indicating a second order 
phase transition with an infinitely large critical exponent. The 
observed deviation of T c from 1 is a finite size effect. 

A remarkable feature of the MC dynamics is that by cross- 
ing T c from above, a scale-free graph (with a degree distribu- 
tion ~ k ' with 7 ~ 3) appears at some point of the evolu- 
tion of the graph form the random configuration towards the 
star. This supports the notion that scale-free graphs are typ- 
ically non-equilibrium (dynamical) configurations. The MC 
dynamics is governed by the change of the energy associ- 
ated with the relocation of an edge. Estimating the energy 
change of a vertex by the derivative of the single vertex en- 
ergy f(ki) = -h In(fci), we get AE = 1 - ln(fei). Plugging 
this into the Boltzmann factor, exp[-AE/T], at T = T c = 1 
we get a quantity proportional to ki for the acception/rejection 
ratio of a randomly selected move. Since the preferential at- 
tachment in the Barabasi-Albert model [4] is proportional to 
ki, it is natural that our dynamics also produces scale-free 
graphs. 

Due to the macroscopic number of edges of the most highly 
connected vertices in the compact configurations, the graph 
energy is a non-extensive quantity. More precisely, the en- 
ergy in different topological states scales differently with the 
size of the system. For instance, when f(ki) — — fcjln(fcj), 
the energy of the star and the fully connected subgraph scales 
as N\n(N), whereas that of the dispersed state scales as N. 



Thus (unlike in the mean-field Ising model), there is no way 
to choose an appropriate coupling constant that could render 
the energy extensive in all topological states simultaneously. 

However, the dispersed state (having an extensive graph en- 
ergy) can equally be studied in the grand canonical ensemble. 
There, the degree distribution can be expressed as |6] Pk = 
Cexp[— f(k)/T — p,k]/k\, where C is a normalization factor 
and the chemical potential [i is adjusted to give the correct (fc) . 
For f(k) = — fcln(fc), using Stirling's formula, the distribu- 
tion takes the form P k = C cxp[-(p-l)k]k^ 1 ' T - 1 '> k /y/2nk. 
When T > 1, this has a tail, which decays faster than ex- 
ponential, consequently, each vertex has a small degree. For 
T < 1, on the other hand, the tail becomes divergent, signal- 
ing a phase transition at T = T c = 1. Note however, that in 
the T < 1 temperature range, due to the non-extensive contri- 
bution of the diverging degrees, the ensembles are not equiv- 
alent, and the grand canonical description looses its validity. 

At the critical temperature, the grand canonical description 
might still be valid. There, by choosing a more general single 
vertex energy /(fcj) = — (ki — a) \n(ki) and setting (k) such 
that n = 1, the degree distribution acquires a power law tail 
(Pfe ~ / S ^( Q + 1 / 2 )) and the network becomes scale-free. We 
have to stress though that the scale-free network at T c is not 
general: for p, > 1 the tail decays exponentially, and for p < 1 
the tail diverges. 

Although in this paper we assumed that (k) < 1, this is 
not a necessary requirement, when the energy is assigned to 
single vertices. For large average degree ((fc) > 2) the only 
difference is that one vertex cannot collect all the edges, and 
thus, several stars appear in the "star" configuration. Finally, 
further interesting directions in the context of the above study 
include the investigation of additional relevant forms for the 
energy [e.g., E — (k — n) 2 with n > 1.5] and the joint effects 
of restructuring and growth. 
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